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THIS STUDY WAS DESIGNED TO DETERMINE AND NOTE 
SIMILARITIES AND DIFFERENCES IN THE COGNITIVE OBJECTIVES OF 
EXAMINATIONS USED IN NINTH GRADE COURSES IN A JUNIOR HIGH 
SCHOOL. SEMESTER EXAMINATIONS FOR 1963-64 PREPARED BY 
INDIVIDUAL TEACHERS OR BY TEACHERS AS MEMBERS OF COMMITTEES 
WERE ANALYZED BY TEST ITEMS ACCORDING TO THE TAXONOMY OF 
EDUCATIONAL OBJECTIVES— COGNITIVE DOMAIN (A HEIRARCHY OF 
INCREASING COMPLEXITY FROM ..NOWLEDGE, TO COMPREHENSION, TO 
APPLICATION, TO ANALYSIS, TO SYNTHESIS, TO EVALUATION). ITEM 
FREQUENCIES WERE TABULATED AND PERCENTAGES CALCULATED. 

COURSES COVERED WERE CIVICS, COLLEGE PREPARATORY (CP) WORLD 
HISTORY, CP ALGEBRA, GENERAL MATHEMATICS, CP BIOLOGY, GENERAL 
SCIENCE, BEGINNING AND ADVANCED FRENCH, ENGLISH, HOME 
ECONOMICS, AND BUSINESS TRAINING. THOUGH THE RANGE OF 
COGNITIVE OBJECTIVES WIDENED FOR CP STUDENTS, EMPHASIS IN ALL 
3 PROGRAMS OF STUDY (CP, BUSINESS, AND PREVOCATIONAL) WAS 
HEAVIEST ON KNOWLEDGE OF SPECIFICS. IN ALL PROGRAMS, AT LEAST 
HALF OF THE QUESTIONS REQUIRED ONLY MEMORY. THERE WAS OVERALL 
LACK OF CONCERN FOR THE AREAS OF ANALYSIS, SYNTHESIS, AND 
EVALUATION. ONLY IN ENGLISH AND, FOR A LIMITED GROUP, IN 
WORLD HISTORY, DID STUDENTS HAVE THE INTELLECTUAL CHALLENGE 
OF THE HIGHER COGNITIVE PROCESSES. DISCREPANCIES AND 
RECOMMENDATIONS FOR FURTHER RESEARCH ARE DISCUSSED. THIS 
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T eacher-Made Examinations 

What Kind Thinking Do They Demand? 



E xaminations constructed by teachers are a prominent con- 
sideration in the overall evaluation of students. They persist 
in importance from school entry to graduate programs, and 
their influence is pervasive, particularly upon the manner in 
whicli students study but more importantly upon the ways they 
think and the values they place on intellectual activities. 

Tests reflect the objectives held by the teacher devising the 
examinations. Optimally, objectives for the course, unit, or 
lesson are stated prior to teaching, thus providing direction for 
both teacher and students in pursuing commonly understood 
goals and a reasonable guide to the evaluation' of the under- 
taking. Even when objectives remain unstated, however, tests 
reflect the real objectives held by the teacher who prepares the 
examination. Most teachers know that most successful students 
are “test wise" to soiiie As students review or study for 

tests, they tend to focus their efforts on the kinds of materials 
which they expect the questions to require. If, for example, they 
believe the mathematics test will concentrate on word problems, 
they probably review typical kinds of problems. If they think 
that demonstrating relationships among chronological events 
will be important in a social studies test, they will stress such 
relationships in their study. 

Since tests relate diiectly to the objectives of a course, a unit, 
or a topic, an analysis of these tests should indicate the kinds 
of objectives thought to.be most important by the teachers de- 
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veloping them. Do test items require pupils to demonstrate that 
they have memorized facts? O** rp/mirA ctMripnfr tr>. tK:r>v 

beyond facts, to demonstrate that they can apply their knowledge 
in a viable situation? Do tests demand that students analyze, 
synthesize, or evaluate— all “higher” thinking processes? In addi* 
tion, do tests in different courses, even in difiierent curricular pro- 
grams of study, emphasize different thinking requirements? This 
study was designed to gain evidence on such questions and to 
demonstrate the usefulness of a powerful analytic system. 
Specifically, its purpose was to determine and note the similarities 
and differences in the cognitive objectives in examinations used 
in ninth grade courses in a junior high school. 



Procedure 

Semester examinations for all ninth grade courses during the 
1963-64 school year were secured from a junior high school in 
Northeastern Ohio. These tests had been prepared by the 
teachers, as individuals or as members of committees. 

Test items were analyzed according to the Taxonomy of Educa- 
tional Objectives: Cognitive Domain.^ This system has six major 
categories in a hierarchy of increasing complexity: 1.00) Knowl- 
edge; 2.00) Comprehension; 3.00) Application; 4.00) Analysis; 
5.00) Synthesis; and 6.00) Evaluation. In addition, each of these 
classes is subdivided into several sections. Examples of the major 
subclasses used in the study and illustrative test items are pre- 
sented below: 

a) Knowledge of specifics (l.IO) —“A list of furnishings and appli- 
ances contained in a home is a (an) .** 

b) Knowledge— ways and means of dealing with specifics (1.20) 
“An atom is to an element as a molecule is to a: (a) colloid; (b) mix- 
ture; (c) compound; (d) solution.*’ 

c) Knowledge-universals and abstractions in a field (1.50)-“Vital 
to making a democracy work in a laige nation is (1) civil liberties, 
(2) political parties, (3) rule by an elected assembly, (4) a cabinet 
system, (5) all of these things.” 

d) Ctomprehension-translation (2.10)— “If n -f 3 is an odd 
integer, what is the next larger odd integer? (a) m -f- 3. (b) n -f 4, 
(c) n -f- 5, (d) 2m -f- 1, (e) Zn -f- S.” 



* Benjamin Bloom (Editor) Taxonomy of Educational Objectives: Cognitive 

Domain. New York: David McKay and Co., 1956, p. 207. 
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e) Comprehension-interpretation (2.20)-“Read Pygmalion. Write 
a summary being sure to tell what the miracle was.” 

f) Analysis— Elements (4.10) —“Analyze the following sentence: 
Mother gave a dollar to the paper boy.” 

g) Analysis— Organizational Principles (4.30)— “Give two important 
characteristics of the writing of each of the following: Kipling, Twain, 
Lindsay, Coleridge.” 

h) Synthesis-Production of a unique communication (5.10)- 
“Why is ‘Three’s A Crowd' considered a romantic play?” 

i) Evaluation-Judgment in terms of external criteria (6.20)- 
“What do you feel is the most important concept you have learned in 
our study of literature?” 

Each item on each test was categorized into the highest appro- 
priate class or subclass. Then, the item frequencies were tabulated 
and percentages were calculated. 

To establish reliability on the classification process, a sampling 
of items from each test was reanalyzed after a three week period. 
No change in classification resulted. In addition, another sample 
of test items was analyzed by another scorer experienced in tb^ 
use of the Taxonomy, and the interscorer agreement was . 87 . 

Findings 

1 

Cognitive Emphases in Ninth Grade Course E xaminfftinns 
Percentage of test items categorized according to the major 
classes and their most prominent subdivisions of the Taxonomy 
are presented in Table I. 

In the social studies area, the civics examination emphasized 
exclusively the knowledge of specific information. The world 
history examination stressed knowledge of specifics, but also 
required students to engage in other types of thinking, including 
syntnesis. Since the world history course was taken by students 
in the cioiiege Preparatory (CP) program perhaps the teacher 
believed the students could engage in such intellectual operations, 
whereas the teacher of civics, taken by non-CP students, may 
have believed his students were not capable of thinking beyond 
the memory level. 

In the mathematics courses, CP students taking algebra again 
were faced with the demands of using a wide range of mental 
processes. Students electing general mathematics, on the other 
hand, had more questions involving memory of specific facts and 
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fewer requiring application than students taking algebra. In 
science, however, CP students taking biology were asked questions 
over knowledge only. General science students, most of whom 
were enrolled in non-CP programs, were required to respond 
primarily to tasks of application; only about 25 per cent of all 
their questions were classified in the knowledge category. The 
examinations in the two French courses were quite similar, 
although French I demanded more interpretation and less appli- 
cation than did Advanced French. 

In the English classes, the differences between the two teachers 
and their goals was pronounced. Each teacher had sections of 
the three ability levels. Teacher A, in all her sections, stressed a 
wide range of thinking processes. Teacher B, however, quite 
consistently emphasized knowledge (of specifics and ways and 
means of dealing with specifics) at all levels and gave only slight 
attention, for the most part, to the other cognitive processes. 
Whereas Teacher A asked all her students to engage in evalua- 
tion, Teacher B asked none of her students to engage in this task, 
not even those in the advanced course. Both teachers asked their 
average classes to engage in less complex mental processes than 
their other groups. 

Questions on the home economics examination were entirely in 
the knowledge classification, 70 per cent calling for knowledge 
of specific facts. In business training, 95 per cent of the test ques- 
tions required only knowledge of specific facts. The proportion 
of test items in both these courses calling for knowledge of specific 
facts seems unusually high, particularly in light of the fact that 
these courses purport to be “practical.” 

Cognitive Emphases in Ninth Grade Programs of Studj’ 

Findings previously presented indicate that, in general, CP stu- 
dents were required to take examinations encompassing a wider 
range of cognitive objectiv^ thaiT^^ counterparts. 

This observation is sharpened, however, when the data are 
grouped according to the three programs of study. Percentages 
of examination questions categorized according to th6 major 
Bloom categories for College Preparatory students (CP) are 
presented in Table 2, for Business (Bus) students in Table 3, 
and for Prevocational (PreV) students in Table 4. Because of 
the differences in objectives evidenced by the two English 
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TABLE 2. Percentage of Examination Items in College Preparatory 
Prog[ram Courses Oassified in Differing Taxonomy Categories 





Algebra, Advanced French, 


Algebra, Advanced French, 


Objectives 


Biology, English 


World History, English 




English 


English 


English 


English 




Teacher A 


Teacher B 


Teacher A 


Teacher B 


Knowledge 










I.IO 


41 


44 


32 


35 


1.20 


1 


6 


2 
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1.30 


4 


4 


6 
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Comprehension 










2.10 


3 


3 


3 


3 


2.20 


0 


0 


1 
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Application 










3.00 


34 


29 


34 


30 


Analysis 










4.10 


4 


6 


4 


6 


Synthesis 










5.10 


8 


6 


12 


13 


Evaluation 










6.20 


6 


0 


6 
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TABLE 3. Percentage of Examination Itenos in Business Program Courses 


Glassined in Differing Taxonomy Categories 






General Business, 








General Science 


General Business, 


Objectives 


General Mathematics 


General Science, Algebra 




English 


English 


English 


English 




Teacher A 


Teacher B 


Teacher A 


Teacher B 



Knowledge 

1.10 

1.20 

1.30 

ComprehelMon 

2.10 

Application 

3.00 

Analysis 

4.10 

4.30 
Synthesis 

5.10 

Evaluation 

6.20 



50 

4 

2 

2 

30 

3 

1 

6 

2 



57 

6 

2 

2 

27 

0 

0 

6 

0 



44 
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2 

32 

2 

1 



51 

6 

7 

2 

29 

0 

0 

6 

0 
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TABLE 4. Percentage of Examination Items in Prevccational Program 
Courses Classified in Differing Tcxofiotny Categories 



Objectives 


General Math, Home Ec., 
General Science 

English English 

Teacher A Teacher B 


General Math, Home Ec., 
Civics 

English English 

Teacher A Teacher B 


Knowledge 

1.10 


39 


45 


57 


64 


1.20 


8 


8 


8 


8 


1.30 


2 


2 


0 


0 


Comprehension 

2.10 


2 


9 


2 


9 


Application 

3.00 


30 


28 


14 


12 


Analysis 

4.10 


2 


B 


2 


8 


Syntl'rsis 

5.10 


11 


1 


11 


1 


Evaluation 

6.20 


6 


0 


6 


0 



teachers, data in eadi program are further subdivided. Thus, 
these three tables represent the cognitive emphases in the typical 
course schedules in the three programs. 

The “recommended” CP program included English probably 
the accelerated course, advanced French, algebra, and either 
biology or world history. Students in the business course, pri- 
marily girls, took English (for the most part, the average sec- 
tions), general business, general science, and either general mathe- 
matics or algebra. Prevocational students took either home 
economics or industrial arts, English (probably in “basic” Eng- 
lish sections), general mathematics, and either general science or 
civics. 

Examination of Tables 2-4 reveals that there was great simi- 
larity in the cognitive objectives within each of the three pro- 
grams of study, regardless of choice of major elective course. 
Table 5 summarizes, according to program of stu^y, the per- 
centages of examination items in each of the major Taxonomy 
categories. The similarity of cognitive objectives v/ithin programs 
persists between programs when one examines Table 5, Overall, 
the ninth grade examinations show teachers’ preoccupation with 
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TABLE 5. Range of Percentage of Examination Items in Courses in the 
Three Programs of Study Classified in the Major Taxonomy Categories 



Objectives 


Prcvocational 

% 


Business 

% 


College 

Preparatory 

% 


Knowledge 


49-72 


55-65 


40-54 


Comprehension 


2-9 


2 


3-4 


Application 


12-30 


27-30 


29-34 


Analysis 


2-8 


0-3 


4-6 


Synthesis 


1-11 


6 


6-12 


Evaluation 


0-6 


0-2 


0-6 



knowledge of specifics. In all programs, at least half of a students’ 
questions required only memory. For PreV students who took 
English with Teacher B and civics, almost three-fourths of their 
examination items called only for knowledge. Emphasis on recall 
of specific information showed a slight decline along the prestige 
alignment of programs from PreV to CP. Questions emphasizing 
comprehension received very little attention in all courses in 
each of the programs of study. Items requiring application of 
knowledge constituted quite similar proportions in all three pro- 
grams, although there was somewhat less attention to application, 
interestingly enough, in the PreV program. Had it not been for 
English Teacher A, most students would have had no opportunity 
to engage in examination tasks requiring analysis, synthesis, and 
evaluation. 



Discussion 

The emphasis on memory in the ninth grade examinations 
analyzed in this study is not particularly surprising. Indeed, that 
only about half the items, considering tests in all courses, empha- 
sized knowledge alone is interesting in itself. Since its possession 
is prerequisite to employing it in higher mental operations, 
teachers must properly be concerned that students acquire knowl- 
edge. Nevertheless, to exclude attention to other cognitive areas, 
as was done in the civics and biology tests, seems excessive. Surely, 
learning and thinking in these courses can and should involve 
some attention to operations other than memory. Very interest- 
ing, in this regard, is the observation that English Teacher A em- 
ployed no “knowledge-only” questions with her low ability stu- 
dents. 
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The overall lack of concern for the objectives in the areas of 
3!i3.1ysis, synthesis, snd evnluHtion, while not unusuHl, is surely 
depressing. In a sense, these junior high school students were 
intellectually deprived, not having the opportunity, at least on 
examinations, to deal with much of the basic nature of the 
courses. Thus, these students, academically able and potential 
dropouts, were treated to a steady diet of bits-upon-pieces, specific- 
upon-specific. Only in English and, for a limited group in world 
history, did students have the intellectual challenge of the higher 
cognitive processes. Surely, all these courses could have given 
attention to analysis, synthesis, and evaluation, perhaps in vary- 
ing degrees, but at least some attention. Only as all courses focus 
attention on all the intellectual skills and processes will schooling 
begin to achieve the general goal of fostering thinking. At 
present, if this junior high school is at all representative of others 
in the nation, and there is evidence that it is above-average, much 
concerted attention to this problem is mandatory. 

The gieat similarity within and between the several programs 
of study in this junior high school reveals inconsistent and per- 
haps unknown emphases. Are the cognitive objectives in the 
three programs of study really as similar as they appear to be? If 
they are, should they be? The apparent similarities certainly 
indicate that acquisition and application of knowledge are the 
most important categories of intellectual operations in these 
junior high school examinations. Even so, the summary similar- 
ities conceal the rather striking differences between certain com- 
ponents of the programs, particularly within the social studies, 
science, and the English areas. Courses in these fields emphasize 
different cognitive objectives without apparent rationale. Why 
should civics and world history differ so markedly in their empha- 
sis upon types of thinking? If the reason is that civics is for less- 
able students, then why does biology, offered to the academically 
talented students, emphasize memory almost as much as civics? 
In this junior high school, the civics course was deliberately de- 
signed for potential dropouts so that they might have the under- 
standings and skills required for effective community participa- 
tion. This study would indicate that the aims have little ch nee 
of succeeding until the cognitive emphases are re-examined. Is it 
because general science students are less able th.^t they are re- 
quired to apply knowledge more than the “better" students in 
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biology? Or might it be that the general science teacher is at- 
tempting to make the “meat" of the course more meaningful and 
more palatable. That the prevocational and business students, 
because of academic aptitude, cannot handle the higher mental 
operations is a misconception is clear from the objectives empha- 
sized by English Teacher A. Her “practical English" students 
were faced with more questions (a total of 80 per cent) in the 
analysis, synthesis, and evaluation categories than were her “ad- 
vanced” students who are confronted by 70 per cent of their 
questions in those areas. It might be argued that she was demand- 
ing more than her students could achieve, but hard evidence is 
unavailable on that point at present. One may conclude, at least, 
that this teacher was not maintaining her less-able students on 
a regimen of memorized specific facts, but was encouraging them 
to go beyond knowledge to using it and thinking with it in 
different ways. 

Probably, each course offered should provide opportunities for 
students to develop all of the cognitive skills. The extent to which 
each curricular area emphasizes each of the cognitive objectives 
surely is not identical. Recognition that knowledge is funda- 
mental to all other cogjnitive goals is certainly not justification for 
emphasising its acquisition to the exclusion of thinking processes. 

The teacher-made examinations analyzed in this study clearly 
emphasized the objective of knowledge acquisition and the 
mental process of memory. Perhaps the examination items do not 
adequately represent the scope of intellectual objectives imple- 
mented by the teachers as they work in their classrooms. On this 
hypothesis there can be only doubt at present. Studies should be 
designed to investigate the nature of teachers’ discourse, particu- 
larly their substantive remarks, for the cognitive objectives 
emphasized. In addition, teachers may very well be unaware of 
the extent to which they emphasize certain types of intellectual 
objectives and ignore others. Analysis of their own examinations, 
alone or as members of curriculum study groups, might well lead 
to better test items and as well, implementation of the general 
concern for the development of thinking in American schools. 
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